SURVEILLANCE SYSTEM WITH IDENTIFICATION CORRELATION 

RELATED APPLICATION 

[001] This application claims the benefit of U.S. Provisional Application 
No. 60/430,468, filed December 3, 2002. 
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FIELD OF THE INVENTION 

[0002] The present invention relates video surveillance system and radio frequency 
identification (RF-ID) filtering and, more particularly, to tracking movement and location of objects 
using video surveillance and RF-ID filtering systems. 
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BACKGROUND OF THE INVENTION 

[003] Currently, surveillance and security systems using radio frequency identification 
(RF-ED) tags or other radio frequency (RF) tracking systems can track the movement and 
location of objects and people that are wearing the tags within the margin or error for the device. 
However, these systems have no means of tracking people or objects that are not wearing the RF 
tracking tags. Similarly, some sophisticated video surveillance systems can detect and monitor 
the movement and location of objects within a given area. However, these video surveillance 
systems require a human interface to determine if the object or person should or should not be in 
a specific area. It would be desirable to resolve these problems of monitoring an area with video 
surveillance and determining if an object or person is authorized to be in that area. 
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SUMMARY OF THE INVENTION 

[004] The present invention provides a system for monitoring an area with surveillance 
system and determining if a person or object is authorized to be in that area by correlating the 
location of objects being tracked by the surveillance system, such as, but not limited to digital, 
non-digital and infra-red video, with those of a tracking system, such as a RF tracking system or 
similar devices like, but not limited to, a GPS and radio signal transceiver system. The system 
outputs a list of objects that are being monitored within a given area by the surveillance systems, 
and whether or not these objects are associated with the tracking tags, such as a RF tracking tag, 
being tracked by the monitoring and tracking systems. The system can then notify the system 
operator of an unauthorized object or person within a given area. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

[005] Further features and details of the present invention will be apparent with reference 

to the following description and drawings. 

[006] FIG. 1 is a block diagram of an embodiment of the invention; and 

[007] FIG. 2 is a diagram of a video surveillance system and a tracking system using an 

embodiment of the invention. 

DETAILED DESCRIPTION OF THE INVENTION 

[008] As shown in FIG. 1, the system takes geo-spatial location information on multiple 
objects being provided by several different position location or tracking systems and surveillance 
systems and compares that information in relation to time and space to determine if each of the input 
systems is referring to the same target. Given that these position location systems and surveillance 
systems are able to locate and track an object within a given margin of error (e.g., plus or minus a 
certain distance), the system applies a logic algorithm to determine if each system is referring to the 
same object. 

[009] The resulting system output is a list of objects within the surveillance area, and 
whether or not each object is associated with a tracking tag, such as a RF tracking tag. The system 
identifies a multiple of objects, independently, within the designated area. The system also determines 
whether or not the tracking tag is authorized to be within that area. 

[0010] The system may be connected to a number of surveillance systems or position 
locating systems that each independently generating location information on a number of different 
targets. These inputs can be provided from a number of different location collection devices, such 
as tracking systems, security cameras and surveillance systems. Surveillance systems include, but 
are not limited to digital, non-digital and infra-red video. Tracking systems include, RF tracking 
systems and similar devices like, but not limited to, GPS and radio signal transceiver systems. 
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[001 1] The input to the system are geo-spatial location information in a variety of different 
forms (e.g., x and y coordinates, latitude and longitude, map grid reference, etc.), as well as a time 
stamp as to when the object was in a particular location. The input to the system is from a database 
or map that the surveillance system is using to track the location of a number of different objects 
within the area under surveillance. 

[0012] The system takes the target information from each of the different systems and 
compares them to determine if they are referencing the same target. This comparison is done in 
relation to time and the relative position of the target. Due to the margin of error associated with 
the target positions for each of the inputting systems, the system uses a logic algorithm to determine 
if the inputting systems are referring to the same target. The system also determines if there are 
objects being detected by some inputting systems that are not being detected by other systems and 
flags these objects as requiring an operator's attention or an alarm may be given by sound, light, or 
other means by the system to notify the operator. 

[0013] The invention may be used with both an object with an authorized tracking tag or 
an object without a tracking tag. As shown in FIG. 2, an embodiment of the invention is connected 
to a video surveillance system and a RFID, RTLS, or RF tracking system. Both the video 
surveillance and RF tracking systems are capable of determining the location of objects within the 
area under surveillance and the time at which the object was in that location. However, both of these 
types of object tracking have inherent limitations. The video surveillance system requires a human 
interface to determine if the object or person should or should not be in a specific area, and the RF 
tracking system has no means of tracking objects that are not wearing the RF tracking tags. 

[0014] In the first case, an object with a RF tracking tag that is authorized to be in the area 
enters the surveillance area. The RF tracking system detects the card, its location, and the time at 
which that location was determined. This tracking system information is provided to the system 
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At the same time, the video surveillance system detects the object and its location. This surveillance 
system information along with the time at which the object was at that location is provided to the 
system. The system takes these two pieces of information and determines the objects being detected 
by both systems are the same object and whether the object is authorized to be in that area. 

[0015] In the second case, an object without a RF tracking tag enters the surveillance area. 
Because the object does not have a RF tracking tag, the RF tracking system does not detect it. The 
video surveillance system detects the object and passes the location and time the object was at that 
location to the system. The system then determines that the object being detected by the video 
surveillance system is not associated with any of the RF tracking tags being tracked by the RF 
tracking system. The system then determines that object is not being authorized to be in that area. 
The object is flagged as requiring an operator's attention or an alarm may be given by sound, light, 
or other means by the system to notify the operator that the object is not authorized to be in the area. 

[0016] Theft of a tracking tag or a badge, such as a RF-ID badge, is also prevented by 
timely user verification. At a designated time or location, each RF-ID badge user must identify 
themselves biometrically , such as by voice or fingerprint input. If such identification time or location 
is not completed by the user, a notification with the security system occurs to notify the operator, 
or an alarm may be given by sound, light, or other means by the system The designated time may 
be, for example, hourly, daily, such as at the beginning or ending of a worker's shift, or a 
predetermined time during the day. 

[0017] The system is not tied to one specific input device such as a RF tracking system or 
a video surveillance. It can be used to compare objects being tracked by a number of different 
systems to determine which of the objects being tracked are the same and which are not. 
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[0018] While the invention has been described with reference to a specific embodiment, 
various changes may be made and equivalents may be substituted for elements thereof by those 
skilled in the art without departing from the scope of the invention. In addition, other modifications 
may be made to adapt a particular situation or method to the teachings of the invention without 
departing from the essential scope thereof. 
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